Game machine and information storage medium

ABSTRACT

The objective of the present invention is to provide a game machine, a musical tone generation device, and an information storage medium that make it possible to synchronize reproduced sounds and images, even if faults such as skips in those sounds or images occur during the reproduction of sounds and images that have been recorded on optical disk. When a game computation section ( 30 ) in this game machine instructs the reproduction of given sound data that has been recorded on an optical disk, based on the game state, sound data ( 96 ) that has been read from an optical disk ( 90 ) is reproduced by a sound reproduction section ( 60 ) and is output to a sound output section ( 80 ). During this time, a synchronization processing section ( 40 ) performs processing to obtain synchronization with the reproduced sounds, based on synchronization data that was read in together with the sound data, and instructs the images to be reproduced by an image generation section ( 50 ) and also the timing at which images are switched. Since image reproduction is based on instructions from the synchronization processing section ( 40 ) in this manner, the images can be reproduced in synchronization with the reproduced sounds.

TECHNICAL FIELD

The present invention relates to a game machine, a musical tonereproduction device, and an information storage medium that reproducesounds and images that have been recorded on an optical disk.

BACKGROUND OF ART

To increase the interest and degree of excitement of a game produced bya game machine, game images are switched or certain of their attributessuch as their color are changed in time with game music, or thecontroller or the seat in which the player is sitting is made tovibrate.

In such a case, game sounds that are stored on an optical disk such asan ordinary compact disk are reproduced independently of the executionof the game program. To enable this in the conventional art, the timefrom the start of reproduction of the game sounds is obtained bycounting from the game program side during the reproduction of gamesounds from the compact disk, and images are generated insynchronization with the game sounds.

However, in such a method, when a fault such as sound skipping occursduring reproduction from the compact disk, that fault will not bereflected in the program counter and it will no longer be possible tosynchronize the program counter and the game sounds. This causes aproblem in that slippage will occur in images that ought to be generatedin synchronization with game sounds.

DISCLOSURE OF INVENTION

The present invention was devised in the light of the above describedtechnical problem, with the objective of providing a game machine, amusical tone generation device, and an information storage medium thatmake it possible to synchronize reproduced sounds and images, even iffaults such as skips in those sounds or images occur during thereproduction of sounds and images that have been recorded on opticaldisk.

1) A game machine in accordance with an aspect of the present inventioncomprises: an optical disk in which is included synchronization data forsynchronizing with at least one of sound data and image data, within atleast one of the sound data and image data; reproduction means forreproducing at least one of a sound and an image, based on at least oneof the sound data and the image data accessed from the optical disk; andprocessing means for executing given processing in synchronization withat least one of sounds and images to be reproduced by reproductionmeans, based on synchronization data accessed from the optical disk.

In this case, sound data includes data such as musical tone data ontunes used in a game, by way of example.

This optical disk comprises media such as a CD, LD, MD, or DVD.

With a processing means that performs given processing, it is generallydifficult to detect sound skipping, even if a fault such as soundskipping should occur during the reproduction of sounds from an opticaldisk.

However, the present invention makes it possible to receivesynchronization data that is accessed from the optical disk togetherwith the reproduction of musical tones of a tune used in the game, forexample, and perform given processing in synchronization with at leastone of sounds and images to be reproduced by reproduction means, basedon that synchronization data. For that reason, it is possible tosynchronize or recover synchronization based on that synchronizationdata to perform various types of processing, even if sound skipping orimage skipping occur in sounds and images reproduced from the opticaldisk.

Recovery of synchronization means that synchronization can be recoveredimmediately by the synchronization data, if a fault such as soundskipping occurs so that there is a discrepancy in processing withrespect to the sound.

The synchronization data includes data indicating elapsed time since thestart of the tune, data indicating a position or a delimiter of thetune, timing data determined in accordance with the rhythm, tempo, orbeat of the tune, or counter data, by way of example.

The synchronization data is preferably comprised at a constant spacing.

In addition, the optical disk is preferably a compact disk. The compactdisk in this case is formatted in such a manner that it can be read by agame machine, such as a CD-ROM. To ensure that the sound data or imagedata for reproduction is processed simultaneously with thesynchronization data in the game machine, it is preferable that thisCD-ROM conforms with CD-ROMXA standard. Conformity with CD-ROMXAstandard permits computer data to be interleaved with other data, suchas audio data, so that the computer data and the audio data can bereproduced consecutively. In principle, computer data is allocated toempty areas by compressing the sound data.

In a game machine using musical tones for tunes and image data, to beused in a game stored on a compact disk such as a CD-ROM, it is possibleto obtain synchronization or recover such synchronization with thesounds and images that are reproduced from the compact disk, and performimage generation, even if sound skipping or image skipping occurs in thesounds and images reproduced from the compact disk.

2) In the game machine of the present invention, at least one item ofthe synchronization data may be included within a range of data that iscapable of being accessed simultaneously.

In the present invention, it may be possible to achieve more accuratesynchronization, because the synchronization data is always includedwithin each range of data that can be accessed at a time. This alsomakes it possible to recover the synchronization more rapidly

3) In the game machine of the present invention, the synchronizationdata may comprise data indicating at least one of elapsed time sincereproduction start during normal reproduction and elapsed time from apredetermined position.

When synchronization with game music is done by an ordinary gameprogram, the decision of the reproduction position of the tune is oftendone at a certain elapsed time since reproduction start or elapsed timefrom a predetermined position. The predetermined position could be atune delimiter, by way of example. When sound skipping occurs in such acase, the program count will deviate from the tune reproduction, leadingto a loss in synchronization.

In the present invention, however, it may be possible to obtain anaccurate tune reproduction position, by the game program referencing thesynchronization data. Therefore, even if sound skipping occurs in thesound that is being reproduced from the optical disk, it is possible forthe processing means to execute processing to obtain accuratesynchronization or recover that synchronization with the soundsreproduced from the optical disk.

4) The game machine of the present invention may further comprise adisplay section for displaying a game image, and the processing meansmay perform image generation processing on a game image to be displayedon the display section, in synchronization with at least one of a soundand an image reproduced by the reproduction means, based onsynchronization data of the optical disk.

The present invention can make it possible to obtain synchronization orrecover the synchronization with sounds and images reproduced from theoptical disk, even if sound skipping or image skipping has occurred, andperform image generation.

5) The game machine of the present invention may further comprise a gamecontroller for inputting an operation by a player, and the processingmeans may perform processing for output to the controller, insynchronization with at least one of a sound and an image reproduced bythe reproduction means, based on synchronization data of the opticaldisk.

The controller is a device that the player uses to perform inputoperations of the game, and resistive forces, vibrations or the like areoutput therefrom.

In the invention, it may be possible to obtain synchronization orrecover the synchronization with sounds and images reproduced from theoptical disk, even if sound skipping or image skipping has occurred, andoutput resistive forces, vibrations or the like to the controller.

6) The game machine of the present invention may further comprise atleast one of a player platform on which a player rides and a seat onwhich a player sits, and the processing means may perform processing foroutput to at least one of the player platform and the seat, insynchronization with at least one of a sound and an image reproduced bythe reproduction means, based on synchronization data of the opticaldisk.

A player platform is a game plate that resembles skis or a snowboard fora skiing game or snowboarding game, or a game housing that resembles amotorbike, racing bike, or horse for a motorbike, cycling, orhorse-racing game, by way of example. Similarly, a seat on which aplayer sits is a driving seat for a driving game or the like, or a seatthat moves together with a image for an adventure game, by way ofexample.

In the present invention, it may be possible to obtain synchronizationor recover the synchronization with sounds and images reproduced fromthe optical disk, even if sound skipping or image skipping has occurred,and output vibrations or the like to a player platform on which theplayer rides or a seat on which the player sits.

7) The game machine of the present invention may further comprise anoptical signal output section, and the processing means may performprocessing for output an optical signal to the optical signal outputsection, in synchronization with at least one of a sound and an imagereproduced by the reproduction means, based on synchronization data ofthe optical disk.

The optical signal output portion comprises an LED, operation indicationbulb or the like provided outside the housing.

In the present invention, it may be possible to obtain synchronizationor recover the synchronization with sounds and images reproduced fromthe optical disk, even if sound skipping or image skipping has occurred,and output an optical signal.

8) The present invention further relates to an optical disk that isreadable by a game machine, the optical disk storing at least one ofsound data and image data comprising synchronization data as defined bythe present invention.

9) The present invention also relates to an information storage mediumfor reading data from an optical disk in which is includedsynchronization data for synchronizing with at least one of sound dataand image data, within at least one of the sound data and image data,and performing given processing, the information storage mediumcomprising: information for reproducing at least one of a sound and animage, based on at least one of the sound data and the image dataaccessed from the optical disk; and information for executing givenprocessing in synchronization with at least one of sounds and images tobe reproduced by reproduction means, based on synchronization dataaccessed from the optical disk.

This optical disk and the information storage medium of the presentinvention could be the physically same medium. In other words, theoptical disk could be configured to comprise data that is at least oneof sound data and image data, and synchronization data included withinthat data, for obtaining synchronization with at least one of the sounddata and image data; and also comprise information for accessing datafrom that optical disk and reproducing at least one of sounds andimages, based on at least one of sound data and image data on theoptical disk; and information for fetching synchronization data that hasbeen accessed from the optical disk, for synchronizing with at least oneof sounds and images to be reproduced, based on that synchronizationdata, and for performing given processing.

The information storage medium of the present invention preferablyfurther comprises information for synchronizing with at least one ofsounds and images to be reproduced, based on the synchronization data,and for performing image generation processing of game images to bedisplayed on a display section.

The information storage medium of the present invention preferablyfurther comprises information for synchronizing with at least one ofsounds and images to be reproduced, based on the synchronization data,and for processing sounds for output to the controller.

The information storage medium of the present invention preferablyfurther comprises information for synchronizing with at least one ofsounds and images to be reproduced, based on the synchronization data,and for processing outputs to at least one of the player platform andthe seat.

The information storage medium of the present invention preferablyfurther comprises information for synchronizing with at least one ofsounds and images to be reproduced, based on the synchronization data,and for outputting optical signals to an optical signal output section.

10) In the information storage medium of the present invention, at leastone item of the synchronization data may be included within a range ofdata that is capable of being accessed simultaneously.

11) In the information storage medium of the present invention, thesynchronization data may comprise data indicating at least one ofelapsed time since reproduction start during normal reproduction andelapsed time from a predetermined position.

12) The present invention still relate to a musical tone reproductiondevice comprises: an optical disk in which is included synchronizationdata for synchronizing with sound data, within the sound data; imagedata storage means in which is included image data; reproduction meansfor reproducing a tune, based on the sound data accessed from theoptical disk; and image reproduction means for synchronizing with thetune to be reproduced, based on the synchronization data accessed fromthe optical disk, and for performing reproduction processing on an imagethat is stored in the image data storage means.

For example, when karaoke tunes are stored on an optical disk andbackground images for the karaoke are recorded on a storage medium thatis separate from that containing the tunes, the present invention canmake it possible to synchronize accurately or recover thatsynchronization with tunes reproduced from the optical disk, even ifsound skipping of the tunes occurs, and to perform image reproductionprocessing.

13) In the musical tone reproduction device of the present invention, atleast one item of the synchronization data may be included within arange of data that is capable of being accessed simultaneously.

14) In the musical tone reproduction device of the present invention,the synchronization data may comprise data indicating at least one ofelapsed time since reproduction start during normal reproduction andelapsed time from a predetermined position.

15) The present invention still further relates to an informationstorage medium for reading data from an optical disk in which iscomprised synchronization data for synchronizing with sound data, withinthe sound data, and performing given processing, the information storagemedium comprising: information for reproducing a tune, based on thesound data accessed from the optical disk; and information forsynchronizing with a tune to be reproduced by the reproduction means,based on the synchronization data accessed from the optical disk, andperforming image reproduction processing.

16) In the information storage medium of the present invention, at leastone item of the synchronization data may be included within a range ofdata that is capable of being accessed simultaneously.

17) In the information storage medium of the present invention, thesynchronization data may comprise data indicating at least one ofelapsed time since reproduction start during normal reproduction andelapsed time from a predetermined position.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is illustrative of slippage between game sounds and displayedimages when sound skipping occurs in a conventional art system;

FIG. 2 is illustrative of an example of synchronization between gamesounds and images when sound skipping has occurred, using the method ofthe present invention;

FIGS. 3A and 3B show physical images of data recorded on a CD;

FIG. 4 is a view schematically showing the recording format of data on aCD-ROMXA;

FIG. 5 is illustrative of processing that is executed when elapsed timesince the start of a tune has been stored in the data channel;

FIG. 6 is illustrative of display images that are displayed at tunedelimiters every ten seconds;

FIG. 7 is a flowchart of the operation of switching the display imagesof FIG. 6 at tune delimiters every ten seconds;

FIG. 8 shows a functional block diagram of a game machine in accordancewith this embodiment of the invention;

FIG. 9 shows an example of a structure of hardware that can implementthis embodiment;

FIGS. 10A, 10B, and 10C show various different forms of machines towhich the present invention can be applied.

BEST MODE FOR CARRYING OUT THE INVENTION

Preferred embodiments of the present invention are described below withreference to the accompanying drawings.

The characteristics of the present invention will first be describedwith reference to a conventional-art example, taking a case in whichsynchronization is obtained between sounds and images.

When game images are generated in synchronization with game sounds thatare reproduced from a compact disk (hereinafter abbreviated to CD), byway of example, the reproduction position of the current game sound isobtained in the prior art by having the game program count at the sametime that the reproduction starts. Thus, if some sort of fault shouldoccur in the CD (due to shock, or the like), slippage will occur betweenthe counter in the game program and the actual reproduction position.

An illustration of slippage between game sounds and displayed imageswhen sound skipping occurs in a conventional system is shown in FIG. 1.Actual time is denoted by time t and the counter of the game program issynchronized with this actual time. The description that followsconcerns a situation in which the game music has tune delimiters at10-second intervals and switching of displayed images is synchronizedwith these tune delimiters.

In such a case, if the count on the game program side starts at the sametime that a tune starts and processing is done to switch the displayedimage every 10 seconds, the displayed images ought to be switched everytime there is a delimiter in the game music.

Assume, however, that a sound skip occurs between 10 seconds and 20seconds after a tune starts, as shown in FIG. 1 (see reference number130). In this case, tune delimiters that originally came after 10seconds, 20 seconds, 30 seconds, etc. are generated at 110-2, 110-3, . .. and slippages (140-3, 140-4, . . .) are generated away from the gameprogram counts (150-3, 150-4, . . .). Since the displayed images areswitched in accordance with the game program counter, slipping willoccur in the switching timing of the tune delimiters and the displayedimages, and it will not be possible to recover from this slippagebetween game sounds and displayed images.

In contrast thereto, the method of the present invention makes itpossible to design for rapid synchronization recovery if such soundskipping should occur. In accordance with the present invention,synchronization data is incorporated at a constant spacing within thesound data, making it possible to read the sound data andsynchronization data at the same time. When synchronization is obtainedbetween the game sounds and the displayed images, the images areswitched on the basis of this synchronization data.

More specifically, synchronization data that can determine tunedelimiters is inserted at positions that are read simultaneously withthe sound data, for example. On the game program side, processing isdone to switch the displayed image when synchronization data indicatingsuch a tune delimiter is read.

An illustration of the use of the method of the present invention,showing an example of the synchronization of game sounds and images whensound skipping has occurred, is shown in FIG. 2.

Assume that a sound skip occurs between 10 seconds and 20 seconds aftera tune starts, in the same way as shown in FIG. 1 (see reference number230). In the configuration of the present invention, synchronizationdata that indicates the tune delimiter that ought to be detected after20 seconds from the tune start is detected at the point 210-3, which isearlier by amount of the sound slippage (see 240). The displayed imagesare switched at that point. It is therefore possible to switch thedisplayed images in complete synchronization with the tune delimiter210-2, 210-3, . . . , even if sound skipping has occurred.

The description now turns to the format in which data is stored on aCD-ROMXA that is employed by this embodiment of the invention. TheCD-ROMXA differs from an ordinary music CD in that sound data is storedthereon in a compressed form. Physical images of data stored on a CD areshown in FIGS. 3A and 3B.

FIG. 3A is illustrative of the format of data storage on a CD used inthis embodiment of the invention. This format is mainly applicable toCDs containing game software that is used in domestic TV game machines.A game program and game data are stored in a CD-ROM format that can beread by a computer on inner tracks 270 of this CD. Outer tracks 260 ofthe CD contain sound data and synchronization data in CD-ROMXA format.

The outer tracks of the CD 250 of FIG. 3A comprise a plurality ofsectors of data 320-1, 320-2, . . . , as shown in FIG. 3B, where theCD-ROMXA configuration is such that eight channels of sound can bestored thereon.

In this case, the tune data is divided into sector units for storage,where eight channels of data are sequentially read during tunereproduction, then one channel of data is reproduced. In this embodimentof the invention, one channel out of eight channels is allocated to adata channel.

The data storage format used with CD-ROMXA is shown schematically inFIG. 4. In this figure, seven out of eight channels are tune channelsand one channel is a data channel. Reference number 410 denotes thedirection of reading of the CD. The configuration is such that eightsectors, which are sectors for eight channels, can be readsimultaneously at least once. Reference number 420 denotes the directionof reproduction. When tune number 1 is being reproduced, by way ofexample, sound data stored in the sectors 452, 454, and 456 are read inthat sequence for reproduction.

The description now turns to an example of an embodiment that obtainssynchronization between tunes and images, using the method of thepresent invention.

In this embodiment of the invention, elapsed time since the start of atune is synchronized with images stored in the data channel. Anillustration of the processing that is executed when elapsed time sincethe start of a tune has been stored in the data channel is shown in FIG.5.

It is possible to calculate the elapsed time since the start of the tunefrom the speed at which data is read from the recording medium. With aCD, 300 kilobytes of data are read within one second. This means that150 sectors of data are read in one second. Therefore, the time requiredfor reading eight channels of data is given by the following formula:1(second)÷150(sector)×8(sector)=0.0533. . . (seconds)

In other words, the time taken to read eight channels of data is 0.053seconds. Therefore, it is possible to store data that represents elapsedtime since the start of a tune, by storing marks indicating sequentialincrements of 0.053 seconds in the data channel, as shown in FIG. 5.

The description now turns to an example of the reading of thesynchronization simultaneously with the tune and the switching of imagesat tune delimiters every ten seconds.

An illustrative view of display images that are displayed at tunedelimiters every ten seconds is shown in FIG. 6. Assume that a displayimage 510-1 is displayed within ten seconds from the start of the tune,510-2 is displayed from ten seconds to less than 20 seconds, 510-3 isdisplayed from 20 seconds to less than 30 seconds, and 510-4 isdisplayed from 30 seconds to less than 40 seconds. Assume that thedisplay images 510-1, 510-2, 510-3, and 510-4 have image numbers 0, 1,2, and 3, respectively.

A flowchart of the operation of switching the display images of FIG. 6at the tune delimiters every ten seconds is shown in FIG. 7.

When tune reproduction starts, the synchronization data, which wasstored in the data channel that was read simultaneously with theaccessing of the tune, is obtained (steps S10 and S20). The number ofseconds of the obtained synchronization data is divided by ten, and theimage corresponding to the image number of the value of thethus-obtained quotient is displayed on the screen (step S30). When thethus-obtained quotient is 0, for example, 510-1 is displayed; when it is1, 510-2 is displayed; when it is 2, 510-3 is displayed, and when it is3, 510-4 is displayed. The processing of steps S20 and S30 is repeateduntil the tune ends (step S40).

The synchronization data that was read simultaneously with the tunealways corresponds to the position of the tune to be reproduced next.This means that, if sound skipping does occur during this process, thesynchronization that was read in simultaneously with the tunecorresponds to the position of the tune to be reproduced, after thesound skipping has occurred. Thus the present invention makes itpossible to switch images with accurate synchronization with tunes, evenif sound skipping or the like occurs during reproduction.

Note that the data recorded in the data channel is not particularlylimited and thus it could equally well be image information such as acounter or image color matched to the beat of a tune, the shape of aphysical object when it is displayed in three dimensions on a screen, orpositional information of a physical camera. In addition, theconfiguration could equally well be such that synchronization data, suchas elapsed time since the start of a tune, could be comprised togetherwith other information.

An example of a functional block diagram of a game machine in accordancewith this embodiment of the invention is shown in FIG. 8. In this case,an operating section 10 enables a player to input operating informationby operating controls such as a joystick, buttons, a steering wheel, oran accelerator, and operation information that is obtained by theoperating section 10 is input to a game computation section 30.

An optical disk 90 stores a game program 92, image data 94 such asobject information used in image generation, and sound data 96 forreproducing game sounds.

The game computation section 30 performs processing such as for gameexecution, setting various game modes, sending reproduction instructionsto a sound reproduction section 60, and supplying information necessaryfor image generation to a image generation section 50, based on varioustypes of information such as the above described operation information,the game program 92, and sound data 96 stored on the optical disk 90.The functions thereof can be implemented by hardware such as the CPU ormemory.

The image generation section 50 generates the game images, based on theprocessing results of the game computation section 30 and the image data94 that is stored on the optical disk, and the functions thereof can beimplemented by an image generation IC (a dedicated IC, CPU, or DSP), andit can be implemented by hardware such as memory. Images generated bythe image generation section 50 are displayed on a display section 70.

The sound reproduction section 60 generates game sounds (game music,effect sounds, voices, etc.) based on the processing results of the gamecomputation section 30, and the functions thereof can be implemented byhardware such as a sound processing IC, an ADPCM decoder, a D/Aconverter, a low-pass filter, and memory. Game sounds reproduced by thesound reproduction section 60 are output by a sound output section 80.

The game computation section comprises a synchronization processingsection 40. The synchronization processing section 40 performsprocessing to obtain synchronization of generated images with the gamesounds when the sound data is being reproduced, based on thesynchronization data that is recorded within the sound data.

In this embodiment of the invention, when the game computation section30 instructs the reproduction of predetermined sound data that isrecorded on the optical disk, based on the game state, the sound data 96that has been read from the optical disk 90 is reproduced by the soundreproduction section 60 and is output to the sound output section 80.

During this time, the synchronization processing section 40 performsprocessing such as that described by way of example with reference toFIG. 7, based on the synchronization data that was read together withthe sound data, then instructs the timing of image switching and imagesto be created by the image generation section 50. Since the images aregenerated on the basis of these instructions from the synchronizationprocessing section 40, it is possible to reproduce images insynchronization with the reproduced sounds.

The description now turns to an example of hardware for a game machinethat can implement this embodiment of the invention, with reference toFIG. 9. In the game machine shown in this figure, a CPU 1000, ROM 1002,RAM 1004, an information storage medium 1006, an optical disk 1007, asound reproduction device 1400, a sound processing IC 1008, an imagegeneration IC 1010, and I/O ports 1012, 1014, and 1030 are connectedtogether by a system bus 1016 in such a manner that data can be mutuallytransferred therebetween. A display 1018 is connected to the imagegeneration IC 1010, a speaker 1020 is connected to the soundreproduction device 1400, a control device 1022 is connected to the I/Oport 1012, a communication device 1024 is connected to the I/O port1014, and various output devices 1034 are connected to the I/O port1030.

The information storage medium 1006 is mainly used for storing a gameprogram and image information for representing display objects, wheremeans such as a CD-ROM, game cassette, IC card, magneto-optical device,floppy-disk device, or memory could be used therefor. It should benoted, however, that the sound data or image data, which is recordedtogether with the synchronization data that is the characteristic pointof the present invention, is stored in the optical disk 1007.

The optical disk 1007 contains sound data or image data that is recordedtogether with the synchronization data that is the characteristic pointof the present invention, and it could also contain other data such as agame program, image data, and sound data (tone data, score data, andwaveform data). Note that the information storage medium 1006 need notbe provided if all the data and the program necessary for the game canbe stored within this optical disk alone.

The ROM 1002 contains data such as initialization information for themain game machine.

The control device 1022 is equivalent to a game controller and is anapparatus for inputting to the main game machine the results ofdecisions made by the player as the game progresses.

The various output devices 1034 are equivalent to a seat or playerplatform that vibrates in synchronization with sounds and images, forexample, or an optical signal output apparatus, and these devices areused for outputting vibrations, resistive forces or the like as the gameprogresses.

The CPU 1000 controls the entire apparatus and performs various types ofprocessing in accordance with factors such as the game program stored inthe optical disk 1007 or the information storage medium 1006, or signalsthat are input by the control device 1022. The RAM 1004 is a storagemeans used as a work area of this CPU 1000, and data such as givencontents of the optical disk 1007, the information storage medium 1006,or the ROM 1002, or computational results of the CPU 1000 are storedtherein.

With this type of game machine, the configuration is such that gamesounds and game images provided by the sound processing IC 1008 and theimage generation IC 1010 are output as appropriate. The sound processingIC 1008 performs various types of processing for generating game soundssuch as game music, effect sounds, and voices, based on instructionsfrom the CPU 1000 and data such as a game program, tone data, and scoredata from the RAM 1004, the information storage medium 1006, and theoptical disk 1007. The thus generated game sounds are output by thespeaker 1020, via other components such as the sound reproduction device1400.

The sound reproduction device 1400 comprises an ADPCM decoder 1416, anD/A converter 1418, a low-pass filter 1420, and an electronic volume1422.

The ADPCM decoder 1416 generates digital sound signals that are to beoutput, based on the processing results of the sound processing IC 1008and waveform data (data representing the actual physical waveforms ofsounds made by instruments such as a drum or piano) from the opticaldisk 1007 or the like, and outputs them to the D/A converter 1418. TheD/A converter 1418 converts these digital signals to analog signals andoutputs them to the low-pass filter 1420. The output of the low-passfilter 1420 is then input to the electronic volume 1422. The electronicvolume 1422 adjusts the magnitude of the sound in accordance withinstructions from the sound processing IC 1008. The output of theelectronic volume 1422 is input through an amplifier 1424 to the speaker1020, which outputs sounds such as game music, effect sounds, and voicesto the exterior.

The image generation IC 1010 is an integrated circuit that synthesizespixel information for output to the display 1018, based on imageinformation sent from components such as the RAM 1004, the ROM 1002, theinformation storage medium 1006, and the optical disk 1007. Note that adevice called a head-mounted display (HMD) could also be used as thedisplay 1018.

The communication device 1024 exchanges various items of informationused within the interior of the game machine, to and from the exterior,and it can be used to transfer given information to and from anothergame machine connected thereto, in accordance with a game program, or totransfer information such as a game program over a communication line.

The processing described with reference to FIGS. 1 to 8 is implementedby components such as the optical information storage medium 1006storing a game program, the CPU 1000 that operates in accordance withthat game program, and the image generation IC 1010. Note thatprocessing performed by the image generation IC 1010 and the soundprocessing IC 1008 could also be done in a software manner by the CPU1000 or an ordinary DSP.

An example of this embodiment of the invention applied to an arcade gamemachine is shown in FIG. 10A. A player enjoys the game by operatingcontrols such as a joystick 1102 and buttons 1104 while viewing a gameimage shown on a display 1100. Components such as a CPU, an imagegeneration IC, and a sound processing IC are mounted on an IC board 1106incorporated into the game machine. Information for playing the game andinformation for synchronizing game sounds or the like with game imagesor the like are stored in memory 1108, which is an information storagemedium on the IC board. These types of information are hereinaftercalled stored information. This stored information comprises at leastone type of information, such as program coding for executing the abovedescribed processing, image information, shape information for displayobjects, table data, or player information. Sound data comprisingsynchronization data is stored on optical disk (not shown in thefigures), and various types of processing for synchronization with gamesounds are performed on the basis of this sound data and the storedinformation.

An example of this embodiment applied to a domestic game machine isshown in FIG. 10B. Players enjoy the game by operating game controllers1202 and 1204 while viewing a game image shown on a display 1200. Inthis case, sound data that comprises the above described storedinformation and synchronization data is stored in a CD-ROM 1206, whichis an information storage medium that can be freely inserted into andremoved from the main unit.

An example of this embodiment applied to a game machine is shown in FIG.10C where the game machine comprises a host machine 1300 and terminals1304-1 to 1304-n connected to the host machine 1300 by communicationlines 1302. In this case, the above described stored information isstored in an information storage medium 1306 such as a magnetic diskdevice, magnetic tape device, or memory that can be controlled by thehost machine 1300. Each of the terminals 1304-1 to 1304-n has a CPU, animage generation IC, and a sound processing IC. In addition, if gameimages and sounds can be synthesized by the terminals 1304-1 to 1304-nin a stand-alone manner, means such as a game program for synthesizinggame images and sounds is transferred thereto from the host machine1300. In this case, the sound data comprising synchronization data couldbe stored on an optical disk or the like which is provided on theterminal side. If game images and sounds cannot be synthesized thereby,on the other hand, the host machine 1300 could synthesize the gameimages and sounds and output them to a terminal for transfer to theterminals 1304-1 to 1304-n. In that case, the sound data comprisingsynchronization data could be stored on an optical disk or the likewhich is provided on the host side.

Note that the present invention is not limited to the above describedembodiment and thus it can be modified in various ways.

This embodiment was described as relating to an example in which imagesare synchronized with game music that is stored on compact disk, but theinvention is not limited thereto.

It is also not limited to something stored on compact disk; it couldequally well concern something stored on any other kind of optical disk,such as an LD, MD, or DVD. It is similarly not limited to game music; itcan also be applied to other sounds or movie data for moving images.

The above embodiment was further described as relating to an example ofgenerating images in synchronization with tunes, but the items to beoutput in synchronization are not limited to images. For example,vibration or resistive forces could be output to the controller that isoperated by the player. Furthermore, a seat on which a player sits or aplatform that models skis or the like, on which the player rides, couldbe made to vibrate in synchronization with musical tone data or imagesstored on optical disk. Alternatively, optical signals could be outputin synchronization with tunes or images.

Furthermore, the above embodiment was described with reference to anexample in which tunes and images were synchronized accurately withoutany slippage, even if sound skipping has occurred. However, the presentinvention is not limited thereto. Synchronization may also be recoveredafter a temporary slippage between images and tunes has occurred, by wayof example. With prior-art methods, it is not possible for the gameprogram to detect sound skipping or like that occurs duringreproduction, so it is difficult to recover when a temporary slippagehas occurred. The present invention, however, makes it possible torecover synchronization rapidly, even if a temporary slippage shouldoccur.

This embodiment of the invention was also described above with referenceto an example in which synchronization data is data indicating theelapsed time from the start of a tune, but the present invention is notlimited thereto and thus it could be data indicating a tune position ordelimiter, timing data determined in accordance with the rhythm, tempo,or beat of the tune, or counter data, by way of example.

In addition, the present invention can be applied to various gamemachines such as domestic game machines, arcade game machines,simulators, large-scale attractions in which many players canparticipate, and personal computers.

The present invention is also not limited to game machines; it can alsobe applied to karaoke devices or the like.

If background images and effect sounds are output in synchronizationwith musical accompaniment sounds that are recorded on optical disk, byway of example, it is possible to provide a karaoke device that canoutput background images and

effect sounds in synchronization with those musical accompanimentsounds, even if sound skipping occurs therein.

1. A game machine comprising: an optical disk in which is includedsynchronization data for synchronizing with at least one of sound dataand image data, within at least one of the sound data and image data,wherein the sound and/or image data includes delimiters spaced atregular intervals; reproduction means for reproducing at least one of asound and an image, based on at least one of the sound data and theimage data accessed from the optical disk; and processing means forexecuting given processing in synchronization with at least one ofsounds and images to be reproduced by reproduction means, based onsynchronization data accessed from the optical disk, including switchinga displayed image when synchronization data indicates that a sounddelimiter is read and/or switching a sound when synchronization dataindicates that a video delimiter is read, to avoid slippage betweensound and image data.
 2. The game machine as defined in claim 1, whereinat least one item of the synchronization data is included within a rangeof data that is capable of being accessed simultaneously.
 3. The gamemachine as defined in claim 1, wherein the synchronization datacomprises data indicating at least one of elapsed time sincereproduction start during normal reproduction and elapsed time from apredetermined position.
 4. The game machine as defined in claim 2,wherein the synchronization data comprises data indicating at least oneof elapsed time since reproduction start during normal reproduction andelapsed time from a predetermined position.
 5. The game machine asdefined in claim 1, further comprising a display section for displayinga game image wherein the processing means performs image generationprocessing on a game image to be displayed on the display section, insynchronization with at least one of a sound and an image reproduced bythe reproduction means, based on synchronization data of the opticaldisk.
 6. The game machine as defined in claim 4, further comprising adisplay section for displaying a game image wherein the processing meansperforms image generation processing on a game image to be displayed onthe display section, in synchronization with at least one of a sound andan image reproduced by the reproduction means, based on synchronizationdata of the optical disk.
 7. The game machine as defined in claim 1,further comprising a game controller for inputting an operation by aplayer, wherein the processing means performs processing for output tothe game controller, in synchronization with at least one of a sound andan image reproduced by the reproduction means, based on synchronizationdata of the optical disk.
 8. The game machine as defined in claim 4,further comprising a game controller for inputting an operation by aplayer, wherein the processing means performs processing for output tothe game controller, in synchronization with at least one of a sound andan image reproduced by the reproduction means, based on synchronizationdata of the optical disk.
 9. The game machine as defined in claim 1,further comprising at least one of a player platform on which a playerrides and a seat on which a player sits, wherein the processing meansperforms processing for output to at least one of the player platformand the seat, in synchronization with at least one of a sound and animage reproduced by the reproduction means, based on synchronizationdata of the optical disk.
 10. The game machine as defined in claim 4,further comprising at least one of a player platform on which a playerrides and a seat on which a player sits, wherein the processing meansperforms processing for output to at least one of the player platformand the seat, in synchronization with at least one of a sound and animage reproduced by the reproduction means, based on synchronizationdata of the optical disk.
 11. The game machine as defined in claim 1,further comprising an optical signal output section, wherein theprocessing means performs processing for output an optical signal to theoptical signal output section, in synchronization with at least one of asound and an image reproduced by the reproduction means, based onsynchronization data of the optical disk.
 12. The game machine asdefined in claim 4, further comprising an optical signal output section,wherein the processing means performs processing for output an opticalsignal to the optical signal output section, in synchronization with atleast one of a sound and an image reproduced by the reproduction means,based on synchronization data of the optical disk.
 13. An informationstorage medium for reading data from an optical disk in which isincluded synchronization data for synchronizing with at least one ofsound data and image data, within at least one of the sound data andimage data, wherein the sound and/or image data includes delimitersspaced at regular intervals, and performing given processing, theinformation storage medium comprising: information for reproducing atleast one of a sound and an image, based on at least one of the sounddata and the image data accessed from the optical disk; and informationfor executing given processing in synchronization with at least one ofsounds and images to be reproduced by reproduction means, based onsynchronization data accessed from the optical disk, for switching adisplayed image when synchronization data indicates that a sounddelimiter is read, and/or for switching a sound when synchronizationdata indicates that a video delimiter is read, to avoid slippage betweensound and image data.
 14. The information storage medium as defined inclaim 13, wherein at least one item of the synchronization data isincluded within a range of data that is capable of being accessedsimultaneously.
 15. The information storage medium as defined in claim13, wherein the synchronization data comprises data indicating at leastone of elapsed time since reproduction start during normal reproductionand elapsed time from a predetermined position.
 16. A musical tonereproduction device comprising: an optical disk in which is includedsynchronization data for synchronizing with sound data, within the sounddata, wherein the sound data includes delimiters spaced at regularintervals; image data storage means in which is included image data thatincludes delimiters spaced at regular intervals; reproduction means forreproducing a tune, based on the sound data accessed from the opticaldisk; and image reproduction means for synchronizing with the tune to bereproduced based on the synchronization data accessed from the opticaldisk, and for performing reproduction processing on an image that isstored in the image data storage means, when the synchronization dataindicates that a sound delimiter is read including when slippage hasoccurred between sound and image data, and for performing reproductionprocessing on an image that is stored in the image data storage means.17. The musical tone reproduction device as defined in claim 16, whereinat least one item of the synchronization data is included within a rangeof data that is capable of being accessed simultaneously.
 18. Themusical tone reproduction device as defined in claim 16, wherein thesynchronization data comprises data indicating at least one of elapsedtime since reproduction start during normal reproduction and elapsedtime from a predetermined position.
 19. An information storage mediumfor reading data from an optical disk in which is comprisedsynchronization data for synchronizing with sound data, within the sounddata, and performing given processing, wherein the sound and/or imagedata includes delimiters spaced at regular intervals, and performinggiven processing, the information storage medium comprising: informationfor reproducing a tune, based on the sound data accessed from theoptical disk; and information for synchronizing with a tune to bereproduced by the reproduction means, based on the synchronization dataaccessed from the optical disk, and performing image reproductionprocessing for switching a displayed image when synchronization dataindicates that a sound delimiter is read, and/or for switching a soundwhen synchronization data indicates that a video delimiter is read, toavoid slippage between sound and image data.
 20. The information storagemedium as defined in claim 19, wherein at least one item of thesynchronization data is included within a range of data that is capableof being accessed simultaneously.
 21. The information storage medium asdefined in claim 19, wherein the synchronization data comprises dataindicating at least one of elapsed time since reproduction start duringnormal reproduction and elapsed time from a predetermined position. 22.A method for reading data from an optical disk in which is includedsynchronization data for synchronizing with at least one of sound dataand image data, within at least one of the sound data and image data,wherein the sound and/or image data includes delimiters spaced atregular intervals, the method comprising steps of: reproducing at leastone of a sound and an image, based on at least one of the sound data andthe image data accessed from the optical disk; executing givenprocessing in synchronization with at least one of sounds and images tobe reproduced by reproduction means, based on synchronization dataaccessed from the optical disk; and switching a displayed image whensynchronization data indicates that a sound delimiter is read, and/orfor switching a sound when synchronization data indicates that a videodelimiter is read, to avoid slippage between sound and image data. 23.The method for reading data from an optical disk as defined in claim 22,wherein at least one item of the synchronization data is included withina range of data that is capable of being accessed simultaneously. 24.The method as defined in claim 22, wherein the synchronization datacomprises data indicating at least one of elapsed time sincereproduction start during normal reproduction and elapsed time from apredetermined position.
 25. The method as defined in claim 23, whereinthe synchronization data comprises data indicating at least one ofelapsed time since reproduction start during normal reproduction andelapsed time from a predetermined position.
 26. The method as defined inclaim 22, wherein the given processing comprises image generationprocessing on a game image to be displayed on a display section, insynchronization with at least one of a sound and an image reproduced bythe reproduction means, based on synchronization data of the opticaldisk.
 27. The method as defined in claim 25, wherein the givenprocessing comprises image generation processing on a game image to bedisplayed on a display section, in synchronization with at least one ofa sound and an image reproduced by the reproduction means, based onsynchronization data of the optical disk.
 28. The method as defined inclaim 22, wherein the given processing comprises processing for outputto a controller for inputting an operation by a player, insynchronization with at least one of a sound and an image reproduced bythe reproduction means, based on synchronization data of the opticaldisk.
 29. The method as defined in claim 25, wherein the givenprocessing comprises processing for output to a controller for inputtingan operation by a player, in synchronization with at least one of asound and an image reproduced by the reproduction means, based onsynchronization data of the optical disk.
 30. The method as defined inclaim 22, wherein the given processing comprises processing for outputto at least one of the player platform on which a player rides and aseat on which a player sits and the seat, in synchronization with atleast one of a sound and an image reproduced by the reproduction means,based on synchronization data of the optical disk.
 31. The method asdefined in claim 25, wherein the given processing comprises processingfor output to at least one of the player platform on which a playerrides and a seat on which a player sits and the seat, in synchronizationwith at least one of a sound and an image reproduced by the reproductionmeans, based on synchronization data of the optical disk.
 32. The methodas defined in claim 22, wherein the given processing comprisesprocessing for output an optical signal to an optical signal outputsection, in synchronization with at least one of a sound and an imagereproduced by the reproduction means, based on synchronization data ofthe optical disk.
 33. The method as defined in claim 25, wherein thegiven processing comprises processing for output an optical signal to anoptical signal output section, in synchronization with at least one of asound and the image reproduced by the reproduction means, based onsynchronization data of the optical disk.
 34. The game machine of claim1, wherein the range of data is sound data regarding a tune and thesynchronization data capable of being read simultaneously therewithcorresponds to a position of a next to be reproduced tune.
 35. Themethod of claim 22, wherein the range of data is sound data regarding atune and the synchronization data capable of being read simultaneouslytherewith corresponds to a position of a next to be reproduced tune.